feat(anta): add test atomic results #937
Conversation
mtache
changed the title
CodSpeed Performance ReportMerging #937 will degrade performances by 23.36%Comparing Summary
Benchmarks breakdown
|
| add_result(result) | ||
| return table | ||
|
|
||
| def report(self, manager: ResultManager) -> Table: |
There was a problem hiding this comment.
to make this non breaking we need to keep report_all function with the possibility to change the title
There was a problem hiding this comment.
This is internal to ANTA. The title argument should have never been there anyway since it's always the default value... It is never used.
| console.print("Tags found:") | ||
| console.print_json(json.dumps(sorted(tags), indent=2)) | ||
| t.update(device.tags) | ||
| console.print("Tags defined in inventory:") |
There was a problem hiding this comment.
need to update the documentation
| pytest.param(None, 5, 5, id="all results"), | ||
| pytest.param(None, 0, 0, id="result for host1 when no host1 test"), | ||
| pytest.param(None, 5, 5, id="result for test VerifyTest3"), | ||
| pytest.param("Custom title", 5, 5, id="Change table title"), |
There was a problem hiding this comment.
will probably need to add this back to be non breaking
Co-authored-by: Guillaume Mulocher <[email protected]>
|
Description
Add anta.result_manager.models.AtomicTestResult model.
Create a
atomic_resultsfield inanta.result_manager.models.TestResultmodel.Reports supported are
table,text,jsonandjinja.csvandmarkdownwill be supported in another PR.Considering the test:
The exemple below is a serialisation of the
TestResultmodel of the test defined above:{ "name": "mtache-leaf2a", "test": "VerifyReachability", "categories": [ "connectivity" ], "description": "Test network reachability to one or many destination IP(s).", "inputs": { "filters": { "tags": [ "mtache-leaf2a" ] }, "hosts": [ { "description": "mtache-spine1 Ethernet3/1", "destination": "10.255.255.4", "source": "Ethernet49/1", "vrf": "default", "repeat": 1, "size": 100, "df_bit": false }, { "destination": "10.255.255.10", "source": "10.255.255.11", "vrf": "default", "repeat": 1, "size": 100, "df_bit": false } ] }, "result": "failure", "messages": [ "Unreachable Destination 10.255.255.4 (mtache-spine1 Ethernet3/1) from Ethernet49/1 in VRF default" ], "atomic_results": [ { "description": "Destination 10.255.255.4 (mtache-spine1 Ethernet3/1) from Ethernet49/1 in VRF default", "inputs": { "description": "mtache-spine1 Ethernet3/1", "destination": "10.255.255.4", "source": "Ethernet49/1", "vrf": "default", "repeat": 1, "size": 100, "df_bit": false }, "result": "failure", "messages": [ "Unreachable Destination 10.255.255.4 (mtache-spine1 Ethernet3/1) from Ethernet49/1 in VRF default" ] }, { "description": "Destination 10.255.255.10 from 10.255.255.11 in VRF default", "inputs": { "destination": "10.255.255.10", "source": "10.255.255.11", "vrf": "default", "repeat": 1, "size": 100, "df_bit": false }, "result": "success", "messages": [] } ] }Fixes #427
Checklist:
pre-commit run)tox -e testenv)